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ABSTRACT 

This document describes a learning nodules reviev 
process implemented at Governors State University, The review process 
was designed to; (1) assess the releyance of each learning module to 
instructional program needs; (2) enhance the quality of the content 
of each learning module; (3) improve the effectiveness of 
competencies and instructional objectives as devices for 
communicating ideas to students; (4) assure the quality and internal 
consistency of competencies, student work, and evaluation; (5) 
increase the likelihood of equitability. among different learning 
modules in the amount of work required of students for the credit 
granted; (6) aid in the development of learning module components; 
and (7) enhance the professional development of all faculty members. 
(MJM) 
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Inbroduction 



One of the unique cliaracteristics of Governors State University is its com- 
mitment to competency-based instruction. This is clearly Indicated in the 

Univer^^ity 's Educational Planning Guidelines' ^ and in numerous other documents 

2 3" 

prepared by the faculty. In a competency-based instructional system, 

certain assumptions ere fundamental including: 

1. Competencies expected of students completing prograjn elements 
can be described in functional terms, 

2, Instructional procedm^es can be designed and implemented that 
will effectively aid students in attaining these competencies, 

3# Achievement of competencies can be directly or indirectly 
measured and verified with a reasonable degree of accuracy* 

As a means of implementing a competency-based instructional system, the planning 

staff at Governors State University defined learning modules as the primary 

instructional eler.<?nt, similar to courses at other institutions. However, there 

are several differences between a course and a learning module; among the most 

significant are the following: 

1. Learning modules are usually interdisciplinai^y in content. 

2. Learning modules are usually "team taught" by two or more pro- 
fessors , 

3. Learning modules ideally indicate alternative means by which 
students can achieve competencies. 

l*. Learning modules are usually self-paced; that is, students 
can work at their own rate, imposing theiv own deadlines, 

5» Written descriptions of learning modules are prepared prior to 
offering and are available to students as guides to study and 
work. The descriptions contain several elements including 

— a rationale which describes the relevance of the learning 
module to competencies expected of graduates from specific 
programs and to the "world" outside the university; 

— a statement of compete ncies that students will attain by 
completing the learning module; 

— a list of instructional objectives that contribute to these 
competencies ; 



Educational Planning Guidelines Park Forest South, Illinois: Governors 
State University, Undated* 

Vartgow, J., et al. An Instructional Syst ems Paradi f^ for Governors S tate 
University , Park Forest South, Illinois: Governors State University, 19Y3» 

Position Papers 2,3,'u7>9 prepared by the faculty of the College of Environ- 
mental and Applied Sciences of Governors State University detail the philosophy 
and procedures of implementing competency-based instruction at the senior 
college level. 
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a pro-asse ss ment , which helps students determine if they have 
the essential prerequisites for the learning module, or if 
they have already attained the competencies and thus do not 
need to enroll in the learning module j 

— assignments and tasks that are designed to help students 
achieve competencies ; 

— resources needed to complete assignments and tasks; and 

— cri teria that will be used in verifying achievement of com- 
petencies. 

6, Professors can initiate a learning module without prior approval of 
faculty, administrators or a curriculum review committee. This is 
to enhance faculty members freedom and creativity by not putting 
obstacles in the path of innovation. 

Each of the characteristics of learning modules ^ especially the last listed, 
necessitates a system for learning module review that is different from course 
approval procedures found in most universities. Such a system should be con- 
structive in its outcomes and enhance the quality of each learning module. 
Moreover, it should allow for appraisal of the relevance of learning modules 
to university* collcgial and program objectives and to students' personal and 
professional. needs. The review process should foster examination of the 
quality and internal consistency of learning module components and it should 
help to assure rea.^onable equitability in the amount of work required for each 
unit of credit granted. Finally, the review process should result in improved 
instruction and increased professional growth for all faculty members. A sys- 
tem of learning modulo review meeting these qualifications has been designed 
and implemented. T:» is described below. 

The Review Process 
The purposes of learning module review are: 

1. to assess the relevance of each learning module to instructional 
program needs ; 

2. to enhance the quality of the content of each learning module; 

3. to improve the ef fectivonoss of competencies and instructional 
objectives as devices for communicating ideas to students; 
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'u to assure the quality and internal consistency of competencies, 
student work, and evaluation; 

5» to increase the likelihood of equitability among different learning 
modules in the oraount of work required of students for the credit 
granted ; 

6* to aid in the development of learning module components; and 
7. to enhance the professional development of all faculty members. 

In the review process, data are obtained from at least five sources: 
Professional peers within the college are best able to assess the revelance 
of learning modules to instructional program needs. They also may be able to 
address the quality of content and provide a Judgment on the "work/credit 
ratio." Thus, this group will evaluate learning modules from a perspective of 
relevetnce euad quality of subject matter. 

Instructional development specialists are best able to Judge the instructional 
soundness of learning modules. Thus, they will revievr the competencies, assign- 
ments, evaluative mechanisms and other components of learning modiiles from a 
perspective of seeking ways of improving instructional effectiveness. 
Professional peers in other institutions if carefully chosen, will bring ex- 
pertise and perspectives beyond that possessed by collegial faculty members to 
the appraisal of leai^ning module content and organization. External reviewers 
also will provide additional input on internal consistency of module components 
and "work/credit ratio/' Thus, peers outside the college review learning nodules 
primarily from the perspective of content expertise, augmenting that which exists 
intromurally. 

Students make Judgments on learning modules frou the consumers' perspective. 
Thoy assess the organization, quality and relevance of content, effectiveness as 
aids in achieving competencies, and 'Vork/credit ratio*" 

Registrar's records on students completion rates in conjunction with other 
data, provide information of value in improving learning modules and their 
delivery. Since self-pacing of instruction is one mechanism for individ- 
ualization at Governors State University, student completion rates may be 



related to learning module organization, lliat is, if learning modules are 
poorly organized, or require excessive work, students^ progress may be im- 
peded unnecessarily. On the other hand, if evaluation mechanisms are not 
appropriately defined » students may obtain credit for competencies they have 
not achieved. Thus, completion rates provide clues regarding instructional 
quality when used in conjunction with data from other sources. 

Internal review by professional peers and instructional development specialists 
is designed to occur during the second offering of each learning modole and 
thereafter on each third offering, or every two years for infrequent offerings. 
The learning modules descriptions and any supporting materials supplied by 
the professor arc given to appropriate subject matter specialists and to in- 
structional development staff members along with a Learning Module Review 
Fom (Appendix l). Learning modules are usually reviewed internally by at 
le ^ two individuals from each of these groups, using the criteria specified 
on the form. The resiats of the review are compiled by the College's Coor- 
dinator of Curriculum and Instruction who assigns an Instructional Development 
Specialist the responsibility of (a) providing the professor feedback from the 
review and (b) working with the professor to define and implement appropriate 
actions to improve the learning module. 

Students routinely evaluate instruction at the end of each eight week session 
using the Student Kvaluation of Instruction Form (Appendix II), Data from 
these evaluations and those from the Registrar's records on student completion 
rates are provided to individual faculty members along with collegial averages. 
Each professor can evaluate data on completion rates and students' perceptions 
of content, organization and delivery of the learning module and use these data 
in improving both module design and delivery techniques. 

External review is scheduled to occur during the third offering of the learning 
nodule, after the professor has incorporated data from internal review and student 
evaluations. The professor and the College's Coordinator of Curriculum 



aiid Instruction mutually agree upon an external reviewer who has appropriate 
subject matter expertise and concern about instruction to provide a meaningful 
review. The external reviewer is sent a copy of the learning module and any 
supporting materials along with a statement about the nature of the College, 
its students and the instructional program of which the module is a part and 
the criteria to be used in reviewing the learning module. Although these 
criteria may vaiy somewhat depending on the learning module and instructional 
prograjiij the following serve as guidelines: 

1. Does the content of the learning module represent valid > 
contemporary thinking about the subject? 

2. Is the content well conceptualized? 

3. Is the content organized in a way that is meaningful for the 
intended student population? 

h> Does the learning module present significant alternative points 
of view regarding the subject matter? 

5i Are the learning module competencies important ones for students 
to acquire? 

6. Does, the leax'ning module represent an efficient and effective 
means of achieving the competencies? 

T- Is the work required consonant with the amount of credit given? 

Results ■ . 

The system for learning module review is nearing full operational status in 
the College of Environmental and Applied Sciences, one of the University's 
four Colleges* Internal review was initiated in the Summer of 19Y3. Approx- 
irr.ately forty learning modules have been reviewed during the past eight months. 
Student evaluation of instruction and reporting of student completion rates 
were routinized during the Autumm of 1973* The procedures for external review 
have not been fully resolved, andj at this time, only a few learning modules 
have been critically reviewed by professional peers outside of the College. 

Review by professional peers within the College has been of limited effective- 
ness. Because the faculty is Si^iall, there is usually only one ^'expert^^ in a 



subject specialty. Otheri? in the saino instructional program 'have their own 
specialty; thus ^ because of faculty size i there is less critical review and 
analysis of content and its organization than was anticipated. Also some 
faculty members may be reluctimt to critize their co-workers' learning modules 
in any manner including relevance to program goals. As external review is 
expanded, these limitations « of peer review will be minimized; internally, hovr- 
ever, professional peers need assume more responsibility for monitoring 
efficient and effective instructional delivery by helping to improve or elim- 
inate irrelevant and poorly conceptualized offerings. 

Review by instructional development specialists, on the other hand, has been 
highly productive of useful information* Faculty members' awareness and skills 
have been upgraded in writing competency statements, instructional objectives, 
assignments and evaluation schemes, in improving evaluation procedures and in 
planning for instruction. However, much additional work needs to be done espe- 
cially in developing the means for measuring and verifying student achievement 
of competencies. 

Data from external review have been significant. Individuals outside the 
College bring fresh perspectives on content and its organization. The power of 
external review in improving instruction and aiding professional growth will be 
more f Ay appreciated during the coming months. 

The effects of data from student evaluation of instruction and from module 
completion rates can only be speculated upon at this time. It is hypothesized 
that these data v:ill have greater impact as a curiulative pattern emerges over 
successive sessions. That is, as a faculty member learns about students' re- 
actions to his/her instructional efforts and couples this information with 
data on completion rates , some serious self-assessment and, hopefully, im- 
provement in instructional planning and delivery will occur. Moreover, as 
dDta are assembled from each of the five sources their total effect will bo 
profound. 
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-;i^;pr; tho two iroi^t f;i£;tn f leant results are that tho revlci/ yroccar^ c,c:nerali 'Jy 
1? c- v'opted .>y facility iiioiabora and that it tcnd^) to lie.lp thorn engap;e in on-- 
ftoin,, ^ cur. JTO* on (jnd rc-f lecbion ab.*^ab ovctini/.in^': knov.lodgo i\n6 .instruction, 
i:Oc:iJUGo each leurnin^^ riodule undert^oes review by Gtudents everytitne it i.s 
of To rod J and periodically by peorr. if it is offered iioi'O than onco > the re- 
vUvvi procesf.; ir. r.n over-preaont roiilndor that inGtruotion is a major ror^pon- 
tiibility at Govi^i nors Staf:e University > that faculty nojnbers are accountable 
for it and that all have oblii;ation to vork toward itfi continued iriprove- 
? ^rnt . 

« w ^4 4* 

Ac k n ow 1 e d [^oiae n t s 

author wii^hoi^ to thank tiie professional staff of the Collef,e of Knvlron- 
o:.tal rnd Applied Scicnco^ Tor their holi) in dovojopin^^ thi:? r^ystcn for Loarnin[^ 
rov.iew and ectpt^cici.lly Dr. I):iniel 0, Casai';randfj for hin critical review 
l\ic difir'b of tjii.'i paper. 
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Appendix I 
EAS LEARNING MODULE REVIEW VOm 



Module Title ^ 

Coordinator(s) 

Assistant(s) 

Session Revieved 
Area of Emphasis 



units of Credit 
Program 



PART I - TASK FORCE REVIEW 



A, Relevance to Instructional Program 

1. Is the proposed Module significant: 

a. to the Insti^uctional Program? Yes ^ No > To some degree 

b. to specific competencies for the Area of Emphasis or Orientation? 
Yes , No , To some degree 

c. to other external criteria of significance to students? 
Yes , Ho , To some degree 

If "yes^' to (c) specify source of extei*nal criteria 



Comments : 



2. In the Judgment of the Task Force momberf;, this Module relates to the 
following Areas of Emphasis and Orientations to the degree specified: 

Area of E mphas is or Oricnt&tion (C heck One) 

; . Signi ficanMy^^ ^, Somewhat 

* Signi ficantly^^ , Somevliat^ ^ 

. , _ yigni fioantly__ y Somewhat^ 

^ Significantly , Somewhat 



(Pa;.:e 2 ^ Appendix T) 

B. O.uallty of Content 

1, Is at least one of the reviewers competent to jxhi^^e the quality of the 
' content of this Module? Yes_ ^ No , To some degree 

2, In the Judgment of the reviewers , is the content of this Module: 

a. valid, representing the best contemporary thinking? 

Acceptable ^Acceptable but could be improved , Needs improvement^ 

b. veil conceptualized? 

Acceptable , Acceptable but could be improved jNeeds improvement^ 

c. structured in a way that will be meaningful to students? 
Acceptable , Acceptable but could be. improved >Needs improvement^ 

d. representative of significant alternative points of view? 

Acceptable^ ^, Acceptable but could be improved >Needs improvement^ 

Comments; 



C. v'ork/Credit Ratio 

1. In the Judgment of the reviewers, the amount of work required of students 

for credit given is about right , too much work , too little work,_ 

Comment s : 



Revi overs _ _ . , ., __ . 

Date 
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PAKT 1.1 - INSTRUCT I Orj A L KKSIGN TEAf-l REVIHW 
A. 



Needs 



Title 






11 uu xnciuaea 


Coordinator(s ) 









Ass\stant(s) 








Credit 


. 






Availability by Session 








Rationale 








ooiTipe ucnc le s 








Pre-as cessment 








Topics 








Suggested Work 








Evaluation 








Resources 









Comments ; 



B. Pre assessment 

1. Is the student^s corrcnand of prerequisite knowledge and skills measured? 
Yes ,No J To some degree 

2. Are pre-assessmenb data used to prescribe instruction for individual 
students? 

Yes ^No J To some degree 

Comments : 



(Vage - Appendix I) 



Bi Corr.petencies 

1. Are the competencies appropriate for use on transcripts? 
Yes j Need improvement 

2. Do the competencies describe desired outcomes of Module clearly? 
^^^^ Need improvement _^ 

3. Are the competencies consistent with the title and rationale? 
Yes I Need improvement 

h. Complete competency grid below (description of criteria in Appendix II). 



Mark an "X'^ where you feel there is congruence 
jctUeen the Ob,1eotive and the Behaviors listed 



CO 

o 



CO 

o 

M 

i 





Competency Number 




1 


2 


3 


h 


5 


6 


7 


8 


9 




Knovledge and Comprehension 






















Application of Scientific 
Knovrledge and Methods 






















K^inual Skills 






















Attitudes and Interoats 




















Orient 'ition 
















i 




Processes of Scientific 
Inquiry I: Observing 
a>id Measuring 






















Processes of Scientific 
Inquiry II: Seeing a 
Pro*:dem and Seeking 
V/ays to Solve It 






















Processes of Scientific 
Inquiry III: Inter- 
preting Data and 
Foivnulating General i- 
j:ations 






















Processes of Scientific 
Inquiry IV: Building, 
Tentingj and Revising 
^1 Theoretical Model 























^'-'Categories adapted from L. E. Klopfer ^'KvalUation of I/^arning in Science Handbook 
on ?orr;: ;itive & Suv/nativo Kvalufi't ion of St udent Irearninf; (B/ Iiloom, J. 1'. Ha5tin£ts> 
G. !Sadau<^ eds) * New York : KcOrAw'-Hill , 1971 
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C. Suggested Work 

!• Is the vork required of the student clearly described? 

Acceptable , Acceptable but could be improved » Needs impfovement^^ 

2i Is the vork required of the student relevant to the Module ^s competencies? 

Acceptable j Acceptable but could be improved j Needs improvement ^ 

3* Is the vork required of the student commensurate vith the credit given? 

Yes ^ Too much work , Too little vork 

I*. Does the work required of the student represent a reasonably efficient 

way of achieving the objectives? 

Acceptable , Acceptable but could be improved Needs improvement^^ 

5* Is the work consistent vith evaluative criteria? 

Acceptable_^ ^, Acceptable but could be improved j Needs improvement 

Comments: 



• D. Evaluation 

1* Are evaluation processes and criteria clearly described? 

Acceptable > Acceptable but could be improved , Needs improvement^ 

2* Is the evaluation consistent vith the competencies? 

Acceptable , Acceptable but could be improved , Needs improvement^ 

3* Does evsQ-Uation allow for feedback to students as they progress through 

the Modiae? 

^^^^^ A , Acceptable but could be improved , Needs improvement ^ 

U. Can success on the evaluation be shown to be directly related to compe- 
tencies of the program, Area of Emphasis or Orientation? 
' Yes ^ No J To some degree 

Comments: 



Reviewers . 

Date 
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Appendix II 

OOVERHORS STATE UNIVtlRSITY STUDENT EVALUATION OF INSTRUCTION 




GOVERNORS STATE UNIVERSITY 

Module NumberQOOO 



Session ^ OO 



STUDENT EVALUATION OF INSTRUCTION 

Year: 1 9QO 



The results of this side of the form will be available to the Coordinators(s), the College Dean, and other appropriate 
personnel to be used to improve the quality of instruction in the University, and will serve as input into decisions 
regarding salary and retention. 



KEY 



PLEASE MARK ONE RESPONSE 
OPTION FOR EACH STATE- 
MENT. IF THE STATEMENT 
DOES NOT APPLY, MARK "NOT 
APPLICABLE." 



StA = Strongly Agree 


SoD Somewhat Disagree 


A = Agree 


D«= Disagree 


SoA ~ Somewhat Agree 


StD =^ Strongly Disagree 


NA« 


Not Applicable 





StA 


A 


SoA 


SoD 


D 


StD 


NA 


1. The instructional objectives for the module were clear . . . 


0 


0 


0 


0 


0 


0 


0 


2. Consistent with the objectives, 1 had an opportunity to 


0 


0 


0 












0 


0 


0 


0 




0 


0 


0 


0 


0 


0 


0 


4. The students were exposed to contrasting viewpoints on 


















0 


0 


0 


0 


0 


0 


0 


5. Instructional activity was consistent with the stated 








0 




0 


0 




0 


0 


0 


0 


6, The coordit»ator(s) has command of the subject matter 














0 




0 


0 


0 


0 


0 


0 


7» 1 was able to arrange for personal consultation and 


0 


0 


0 


0 


0 


0 


0 




8. Evaluation was consistent with the stated instructional 


















0 


0 


0 


0 


0 


0 


0 




0 


0 


0 


0 


0 


0 


0 


10. The learning experiences in this module were interesting 


0 
















0 


0 


0 


0 


0 


0 


Compared to all college-level instructors you have had, how effective has this coordinator (have these coordinators) 


been in this module? 
















One of the More Effective About 


Not as Effective 




One of the 




Most Effective Than Most Average 




as Most 




Least Effective 




(Top 10%) (Among Top 30%} 


(In Lowest 30%) 




(Lowest 10%) 




11-t □ □ □ 




□ 








□ • 




Mi-2 n □ □ 




□ 








□ 




□ □ □ 




□ 








□ 





■ "^'^ "flo^^^^^^ participated in the conduct of this learning rhodule, mark the appropriate response 

g|^|(^ ryinf td' lup^^^^ instructions provided by coordinator. 

{OVtft) 



:-:Mr 



3EI ^orm . 

(Side 2) 



This side of the SEI form is designed for the exclusive use of the Coordinator(s) in improving Instrijctlon. 

COORDINATOR OPTIO N QUESTIONS . If the coordinator<s) provided supplementary questions, use this section 
for responding. ^ 



A ^ ^ i J. Z J. A ^ ^ -2. J- f. -Q. 

12. 0 0 0 0 0 0 0 17. 0 0 0 0 0 0 0 

13. 0 0 0 0 0 0 0 18. 0 0 0 0 0 0 0 

14. 0 0 0 0 0 0 0 19. 0 0 0 0 0 0 0 

15. 0 0 0 0 0 0 0 20. 0 0 0 0 0 0 0 

16. 0 0 0 0 0 0 0 21. 0 0 0 0 0 0 0 



STUDENTSCOMMENT SECTION: Oneway in which coordinators can improve their modules is through thoughtful 
student reactions. If you have any comments to make concerning thecoordinator(s) or module, please write them 
in the space provided below. If you need additional ^pace, use' a separate sheet of paper. 



